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Abstract 

We present a results about convergence of products of row-stochastic 
matrices which are infinite to the left and all have positive diagonals. 
This is regarded as in inhomogeneous consensus process where confidence 
weights may change in every time step but where each agent has a little 
bit of self confidence. The positive diagonal leads to a fixed zero pattern 
in certain subproducts of the infinite product. 

We discuss the use of the joint spectral radius on the set of the evolving 
subproducts and conditions on the subprodutcs to ensure convergence of 
parts of the infinite product to fixed rank-l-matrices on the diagonal. 

If the positive minimum of each matrix is uniformly bounded from 
below the boundedness of the length of intercommunication intervals is 
important to ensure convergence. We present a small improvement. A 
slow increase as quick as log(log(t)) in the length of intercommunication 
intervals is acceptable. 

1 Introduction 

Consider n persons that discuss an issue which can be represented as a real 
number. Assume further that the persons revise their opinions if they hear the 
opinions of others. Each person finds his new opinion as a weighted arithmetic 
mean of the opinions of others. This model of opinion dynamics has been 
analyzed for the possibilities of consensus by DeGroot I . If these weights 
change over time we have an inhomogeneous consensus process. 

While the homogeneous process has strong similarities with a homogeneous 
Markov chain, things get different when inhomogeneity comes in. While a 
consensus process relies on row-stochastic matrices multiplied from the left, 
a Markov process relies on row-stochastic matrices multiplied from the right. 
And infinity to the right is not the same as infinity to the left. 
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Consensus processes are only briefly touched in the context of Markov chains 
12 . Besides the early approaches of opinion dynamics 12] some results have 
been made in the context of decentralized computation 0] . Consensus processes 
fit in the framework of questions about sets of matrices which have the left 
convergence property 'LCP' which is 'RCP' for transposed matrices. 

Recently, there have been independent works that study consensus processes 
and the underlying matrix-products in the context of opinion dynamics [3 111 El j 
multi agent systems where agents try to coordinate [lUL [TT| and flocking where 
birds or robots try to find agreement about their headings ^1 El ■ 

In ^1 El there have been the first attempts to make the concept of the 
joint spectral radius work on consensus processes. 

In this paper we want to analyze the structure that positive diagonals deliver 
in inhomogeneous consensus processes and extend the basic idea of j^El- But 
a result on convergence is only reachable with further assumptions on matrices. 
In the end we will derive a small improvement on acceptable growth of the 
length of intercommunication intervals. 

2 Consensus Processes 

For n £ N we define n := {1, . . . , n}. 

Let A{0),A(1), ... be a sequence of square row-stochastic matrices of size 
n X n. 

For natural numbers s < t we define a forward accumulation A{s,t) := 
A{s) . . . A{t — 1) and a backward accumulation A{t, s) := A{t— 1) . . . A{s). Thus 
A{s, s + 1) — A{s + l,s) — A{s) and A{s, s) is the identity. 

Let a;(0) be a real column vector of opinions and Xi{0) stands for the initial 
opinion of person i. The sequence of vectors x{t) ~ A{t, 0)a;(0) is an inhomo- 
geneous consensus process and a(t)ij stands for a confidence weight person i 
gives to the opinion of agent j at time step t. In this context A{t) is called a 
confidence matrix. 

To understand the convergence behavior of inhomogeneous consensus pro- 
cesses the infinite product A(oo,0) is of interest. 

In this paper we focus on confidence matrices with positive diagonals. Thus, 
we regard processes where persons always have a little bit of self-confidence. 

A row-stochastic matrix K which has rank 1 and thus equal rows is called 
a consensus matrix because for a real vector x it holds that Kx is a vector 
with equal entries and thus represents consensus among persons in a consensus 
process. Suppose that A{t) :— K is a, consensus matrix. It is easy to see that 
for all u > t it holds for the backward accumulation that A{u, 0) = K. (For the 
infinite forward accumulation A{0, oo) it only holds that A{0, u) is a consensus 
matrix but may change with u.) In the following we will point out that there is 
also a tendency of convergence to consensus matrices. 

In the next section we will see that the positive diagonal together with the 
Gantmacher's canonical form of nonnegative matrices |15| will give us a good 
overview on the zero and positivity structure of the processes. 
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In section \^ we go on with a convergence theorem that is built on this 
structure and conclude in section |B1 with a small improvement and discussion 
on how to fulfill the conditions of the theorem. 

3 The positive diagonal 

We regard two nonnegative matrices A, B to be of the same type A ^ B \i 
Qij > bij > 0. Thus, if their zero-patterns are equal. All matrices of 
the same type have the same Gantmacher form, which block structure we will 
outline now. 

Let ^ be a nonnegative matrix with a positive diagonal. For indices i,j G n 
we say that there is a path i — > j if there is a sequence of indices i = ii, . . . ,ik = j 
such that for all / G fc — 1 it holds > 0. We say i,j € n communicate if 

i ^ j and j ^ i, thus i ^ j. In our case with positive diagonals there is always 
a path from an index to itself, which we call self- communicating and thus ' <->•' 
is an equivalence relation. An index i G n is called essential if for every j G n 
with i ^ j it holds j i. An index is called inessential if it is not essential. 

Obviously, n divides into disjoint self-communicating equivalence classes of 
indices Xi, . . . ,Xp. Thus, in one class all indices communicate and do not com- 
municate with other indices. The terms essential and inessential thus extend 
naturally to classes. We define ni := . . . ,np := #2p. 

If we renumber indices with first counting the essential classes and second 
the inessential classes with a class T before a class J ii J ^ X then we can 
bring every row-stochastic matrix A to the Gantmacher form |15| 

'Ax 0' 

A, 

Ag+\.\ ■ ■ ■ ^3+1 

Ap^\ . . . Ap^g Ap^g^l . . . Ap 

by simultaneous row and column permutations. The diagonal Gantmacher 
blocks Ai, . . . , Ap in are square (ni x ni, . . . ,np x Up) and irreducible. Ir- 
reducibility induces primitivity in the case of a positive diagonal. For the non- 
diagonal Gantmacher blocks Ak^i with k = g + 1, . . . ,p and / = 1, . . . , fc — 1 it 
holds that for every fc e {g -\- 1, . . . ,p} at least one block of A^^i, ■ ■ ■ , Ak,k-i 
contains at least one positive entry. 

The spectrum of A is the union of the spectra of all the diagonal Gantmacher 
blocks. 

The following proposition shows that an infinite backward or forward accu- 
mulation of nonnegative matrices can be divided after a certain time step into 
subaccumulations with a common Gantmacher form. 



(1) 
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Proposition 1. Let (^(i))tgN he a sequence of nonnegative matrices with pos- 
itive diagonals. Then for the backward accumulation there exists a sequence of 
natural numbers < to < ti < . . . such that for all i €N it holds 

A{t,+i,t,) A{ti,to). (2) 

Thus, A{ti^i,ti) can be brought to the same Gantmacher form for all i G N. 
Further on, all Gantmacher diagonal blocks are positive and all nondiagonal 
Gantmacher- Blocks are either positive or zero. 

Proof. (In sketch, for more details see |16).^ 

The proof works with a double monotonic argument on the positivity of 
entries: While more and more (or exactly the same) positive entries appear in 
A{t,Q) monotonously increasing with rising t, we reach a maximum at ^q- We 
cut A[tQ,Q) of and find t* when A[t,tQ) reaches maximal positivity again with 
rising t. We go on hke this and get the sequence (A(i*_^^ , t*))i(z^. Obviously, less 
and less (or exactly the same) positive entries appear monotonously decreasing 
with rising i and we reach a minimum at k. We relabel tj := t^^^- and thus have 
the desired sequence (ti)igN with A{ti+i,ti) having the same zero-pattern. 

Positivity of Gantmacher blocks follows for all blocks A{ti+i,ti)Yj x\ where 
we have a path J ^X. If we have such a path, then there is a path from each 
index in J to each index in T and thus every entry must be positive in a long 
enough accumulation. Thus, the block has to be positive already, otherwise 
(ii)ig is chosen wrong. 

To prove the result for forward accumulations, we can use the same argu- 
ments. □ 

Let us consider now a sequence of row-stochastic matrices (A(<:))tgN and 
their infinite backward products A(t, 0) with t — > oo. Thus, we face a consensus 
process where agents may change their confidence weights in every time step. 

Form proposition n we get the existence of a sequence of time step (ti)^^^ 
such that all A[ti^\,ti) have the same Gantmacher form with positive Gant- 
macher diagonal blocks. So, the Gantmacher structure represents, that agents 
find a stable confidence structure. There evolve g > 1 groups where every agents 
trust everyone else internally (but maybe indirectly) and no one outside; this 
repeats for all the time. And there evolve inessential confidence groups in which 
agents trust each other internal but which also have trust chains to one or more 
of the g essential groups. 

Unfortunately, nothing can be said about the distances ti+i — ti. 

4 The joint spectral radius 

We regard a sequence of row-stochastic matrices with positive diagonals (A(i))tgN, 
take the sequence of time steps of proposition^and abbreviate A(i) :— A{tij^\,ti). 
Further on, the A}^(i), A^j (?) are the respective Gantmacher blocks of A{i). So, 
E := {A{i) I i G N} is a set of matrices with the same Gantmacher form, which 
joint spectral radius can be studied. 
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The spectral radius of a matrix A is p{A) := {|A| A is eigenvalue of A} and 
represents the growth rate of the matrix norm of A*. The joint spectral radius 
|S] of a set of square matrices M is 

/5(X) := limsup sup \\A{ii) . . . A{ik)\\i 

k^oo A{ii),...,A(ik)eM 

and represents the maximal growth rate of arbitrary products of matrices from 
M. 

In our setting for all i G N it holds p{A{i)) ~ 1 and due to the fact that 
every product of E is row-stochastic it holds /5(S) = 1, too. But we can do a 
joint transformation of all matrices in S which leads us to a situation where the 
joint spectral radius is more interesting. 

Let us consider the k-th Gantmacher diagonal block Ak for the essential 
class Xk in an arbitrary accumulation Ak(ti+i,ti) —: Ak{i) {k G g, i ^ N). A{i)k 
is positive and row-stochastic. Thus, it has the unique maximal eigenvalue 1 
for the eigenvector 1. (1 is the vector with only one-entries of the appropriate 
length given through the context). And there are no other eigenvalues with 
absolute value one. 

According to an idea outlined in |12[ I14| we can make a transformation 
PkA{i)kP^ =: A'{i) such that the spectrum stays the same but with eigenvalue 
1 removed. For this Pk is a (n^ — 1) x n matrix which rows build an orthogonal 
basis of the orthogonal complement to span{l}. (This can be normalized vectors 
with two nonzero entries which have the same absolute value and different signs.) 

Thus, A'{i) is {uk — 1) x (rifc — 1). To see that the spectrum of A'{i)k is 
the spectrum of A{i)k without 1 consider an eigenvalue A 7^ 1 and one of its 
eigenvectors x. Then y :~ PkX is not zero and an eigenvector of A'(i)k for the 
eigenvalue A. {A{i)kX = Xx ^ PkA{i)kPky = Ay =^> A'{i)ky = Ay.) 

Obviously, all the matrices A{i) have 1 as eigenvalue g times with a g- 
dimensional eigenspace 



eig(^(«), 1) = span{ 
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The *-parts are not necessary equal for all i G N, but it is clear that 1 is in, 
thus the *-parts sum up to multiple of 1. 

Nevertheless, we can generalize the transformation idea of ^1 to our 
setting. We define the {n — g) x n matrix 



Pi 







P := 



Pn 



E 
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where E is the unit matrix of size 



Notice that the blocks are 



not square and thus not diagonal. Now, it holds PA(ti+i,ti)P 











ig+1 



(0 
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A'{i) 



Now we can study the joint spectral radius of S' := PA{i)P^\i £ N. If we 
had /5(S') < 1 this would imply that A{t,{))x{Q) would converge in the entries 
of indices Ii U ■ 



U Xg to a vector in 
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It holds for the spectral radii that p{A'-^{i)) < 1, . . . , p{A'g{i)) < 1, due to the 
the fact that Ai{i), . . . , Ag{i) where positive and thus had no other eigenvalues 
of absolute value one. Further on, the spectral radii of Ag+i{i), . . . ,Ap{i) are 
less than one because for / G {g + 1, . . . ,p} it holds p{Ai{i)) < \\Ai{i)\ \ < 1. The 
second inequality holds due to the fact that all row sums in Ai{i) are less than 
one. {\]A\] := max^ \aij \ in this case.) 

Thus, it holds p{A'{i)) < 1 for all « G N. But unfortunately this does not 
imply yo(E') < 1 ^Tj. Thus, more assumptions must be made to reach a partial 
convergence result. This is subject to the next section, where we use concepts 
of ergodicity. 



5 Convergence 

We define the coefficient of ergodicity of a row-stochastic matrix A according to 
12 as 

n 

t{A) := 1 - min 'S^ min{aife, 0^^}. 

i.j^n ^ — ^ 

The coefficient of ergodicity of a row-stochastic matrix can only be zero, if 
all rows are equal, thus if it is a consensus matrix. 

The coefficient of ergodicity is submultiplicative (see [5]) for row-stochastic 
matrices , . . . , 

t(A,...AiAo) <T(A;)---r(^i)T(Ao). (4) 
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If limj^oo t{A{0, t)) = we say that A{0, t) is weakly ergodic. Weakly ergodic 
means that the A{0, t) gets closer and closer to the set of consensus matrices 
and thus the Markov process gets totally independent of the initial distribution. 

For M C K>o we define min+ M as the smallest positive element of M. 
For a stochastic matrix A we define min"*" A :— min^^^^ a^. We call min"*" the 
positive minimum. 

For the positive minimum of a set of row-stochastic matrices Aq, . . . , Ai it 
holds 

min + (Aj ■ • • Ao) > min +Ai ■ • • min +ylo. (5) 

Theorem 2. Let {A{t))ti=fi be a sequence of row- stochastic matrices with pos- 
itive diagonals, < to < < • ■ • be the sequence of time steps defined by 
proposition^ Ii, . . . ,Xg be the essential and J be the union of all inessential 
classes of A{ti,to) . 

If for all i ^ N it holds min^ ^4(^^+1, ti) > 6i and X^i^i ~ then 



lim A{t, 0) = 








" 










A(to,0) 










not converging 


_ 





where Ki, . . . ,Kg are consensus matrices. (The matrices have to be sorted by 
simultaneous row and column permutations according to Xi, . . . ,Ig, J .) 

Proof. The interesting blocks are the diagonal blocks. It is easy to see due to 
the lower block triangular Gantmacher form of ti) for all i G N, that all 

diagonal blocks only interfere with themselves when matrices are multiplied. 
Let us regard the essential class and abbreviate Ai := A(tij^\,ti)\^Xk,ik\- 
We show that the minimal entry in a column j of a row-stochastic matrix B 
cannot sink when multiplied from the right with another row-stochastic matrix 
A, 



min(j4i?)ij = min > aife&fcj > min6i 



~ ~ fc= 



Thus, the minimum of entries in column j of the product At ■ ■ ■ Aq is monotonously 
increasing with rising i € N. With similar arguments it follows that the maxi- 
mum of entries in column j of the product ■ • • is monotonously decreasing 
with rising i €z N. 

Further on, it holds due to and the definition of the coefficient of ergod- 
icity that 

OO CXD OO 

lim t{A, . . . A^A^) < l[ r(A) - Hil - <5.) < H = = 0- 

i—l i—1 i—1 

The maximal distance of rows shrinks to zero. Both arguments together imply 
that limi^aaiAi . . . AiAq) is a consensus matrix which we call Kk. 



7 



Now it remains to show that the \J ^ J'j-diagonal block of the inessential 
classes converges to zero. 

Let us define ||-|| as the row-sum-norm for matrices. It holds < 
(1 — ^i) and thus like above it holds 

CXD CXD 

i=l i=l 

This proves that limt^oo 0) = 0. □ 

An inhomogeneous consensus process A(t^ O)x(O) with persons who have 
some self-confidence stabilizes (under weak conditions) such that we have g con- 
sensual subgroups (the essential classes) which have internal consensus, while 
all other persons (the inessential indices) may hop still around building opinions 
as convex combinations of the values reached in the consensual groups. 



6 Discussion on conditions for min+ ^4(^^+1, > 6i 

One thing where theorem|21stays unspecific is that it demands lower bounds for 
the positive minimum of the accumulations A{ti^i,ti). But, what properties 
of the single matrices may ensure the assumption miii^ A{ti^i,ti) > Si with 

The first idea would be to assume a uniform lower bound for the positive 
minimum 6 < min^ ^(^) for t- But this is not enough. 

Recent independent research 1131 |Hj has shown that either bounded in- 
tercommunication intervals (ii+i — ti < N for all i e N) or type- symmetry 
{A ~ A^) of all matrices A{t) can be assumed additional to the uniform lower 
bound for the positive minimum to ensure the assumptions of theorem |21 But 
improvements are possible. 

Bounded intercommunication intervals Let us regard 5 < min^ A{t) 
for all t eN. If t,+i -t^ < N it holds by © that min+ A(t,+i,t,) > and 
thus X^i^o — ^ and thus theorem |21 holds. But i^+i — ti may slightly rise as 
the next two propositions show. 

Proposition 3. Let < S < 1 and a G M>o then 

oo 

^alog(n) < oo ^ ^ < e-1. (6) 

Tl=l 

Proof. We can use the integral test for the series 5°'°^^"'' because f{x) := 

§aiog{x) positive and monotonously decreasing on [l,oo[. 
With substitution y = log(x) (thus dx ~ e^dy) it holds 
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The integral is finite if and only if log((5) + 1 < and thus ii 6 < e ^. □ 
Proposition 4. Let < S < 1 and a E ]R>o then 

oo 

^^alog(log(«)) ^ (7) 
n— 3 

Proof. We can use the integral test for the series ^^^^ (5°i°g(i°s(")) because 
f{x) :— (5'''°s('°s(^)) is positive and monotonously decreasing on [3, oo[. 
With substitution y = log(log(a::)) (thus dx — e*^*'"'"^"^(iy) it holds 



oo 



jalog(log(a;))^^ _ j log(S) \og{log{x}) _ j e"'^°^^^^''^ e^'^'^^ dy 

gay(log(5) + l)+e''^y 



The integral diverges because ay{log{S) + 1) + — > oo as y ^ cxd. □ 

Thus, assuming min^ A{t) > S > for alH G N we can allow a slow growing 
of ti+i — ti to fulfill the assumptions of theorem [5] Acceptable is a growing as 
quick as log(log(i)). If ti+i — ti grows as log(i) then it must hold S > e^^ > |. 
This can only hold if each row of A{t) contains only two positive entries (due 
to row-stochasticity) . 



7 Conclusion 

We pointed out the convergence of the zero patterns of accumulations in in- 
homogeneous consensus processes with positive diagonals. It leads to a stable 
Gantmacher form on accumulations. We then extended an idea of ^1^] to a 
potential use of the joint spectral radius for the convergence of inhomogeneous 
consensus processes but saw that further assumptions are necessary to reach 
a convergence result. For this we switched back to the concept of shrinking 
coefficients of ergodicity and could reach a small improvement of former results. 

Perhaps the combination of both approaches may lead to a full characteri- 
zation of inhomogeneous consensus processes with respect to convergence and 
conditions for consensus. 
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